Skip to content

Export control#1568

Merged
Ezequiel-Valencia merged 42 commits into
export-feature-branchfrom
export-control
Aug 15, 2025
Merged

Export control#1568
Ezequiel-Valencia merged 42 commits into
export-feature-branchfrom
export-control

Conversation

@Ezequiel-Valencia
Copy link
Copy Markdown
Contributor

@Ezequiel-Valencia Ezequiel-Valencia commented Aug 5, 2025

The old export system used a queue to buffer export jobs while using RPC and a stateful exporter. The changes made in this PR includes:

  • Moving the export system into Quarkus
  • Updating the export queue to no longer use ApacheMQ but instead ArtemisMQ, introducing an export queue handler
  • Creating a separate docker image for the exporter (toggled by setting a compilation flag)
  • Refactor the export handling system to include less state, and separate the servers event system from the export system
  • Introduce only N5 exports, and update VCell client to use it
  • Add Quarkus export events to the clients asynchronous message manager
  • Annotations to core files to allow for serialization
  • Replace constant numbers and with Enums (improving type safety of options)
  • End to end and functional tests for the export system in Quarkus.

Outside Scope

  • Topics that need to be added for support with old systems
  • Migrate the export status events to a topic, allowing for integration with VCell client status topic
  • Integrate VCell events with Artemis (directly or through a bridge)

@Ezequiel-Valencia Ezequiel-Valencia self-assigned this Aug 5, 2025
@Ezequiel-Valencia Ezequiel-Valencia linked an issue Aug 5, 2025 that may be closed by this pull request
1 task
Copy link
Copy Markdown
Member

@jcschaff jcschaff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

discussed issues with Zeke - approved (but please change timestamps to Unix Epoch and API endpoint from PATCH to GET

@Ezequiel-Valencia Ezequiel-Valencia changed the base branch from master to export-feature-branch August 15, 2025 13:53
@Ezequiel-Valencia Ezequiel-Valencia merged commit 73f3828 into export-feature-branch Aug 15, 2025
9 checks passed
@Ezequiel-Valencia Ezequiel-Valencia deleted the export-control branch August 15, 2025 16:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Export Control Through The New API

2 participants